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Description 

Intelligent Agent with negotiation Capability and 
Method of Negotiation Therewith 

Cross-reference to Related Applications 

5 This application is related to the following U.S. 

Patent Applications, all of which were filed on even date 
herewith by Bigus et al.: U.S. Serial No. 08/822,119 entitled 

"APPARATUS AND METHOD FOR COMMUNICATING BETWEEN AN INTELLIGENT 
AGENT AND CLIENT COMPUTER PROCESS USING DISGUISED MESSAGES," 
10 U.S. Serial No. 08/826,107 entitled "APPARATUS AND METHOD FOR 
OPTIMIZING THE PERFORMANCE OF COMPUTER TASKS USING MULTIPLE 
INTELLIGENT AGENTS HAVING VARIED DEGREES OF DOMAIN KNOWLEDGE" 
and U.S. Serial No. 08/822,993 entitled "APPARATUS AND METHOD 
FOR OPTIMIZING THE PERFORMANCE OF COMPUTER TASKS USING 
15 INTELLIGENT AGENT WITH MULTIPLE PROGRAM MODULES HAVING VARIED 
DEGREES OF DOMAIN KNOWLEDGE." The disclosures of all of these 
applications are hereby incorporated by reference herein. 

Field of the Invention 

The invention is generally related to intelligent 
20 agent computer programs executable on computer systems and the 
like, and in particular, the use of such programs in commercial 
transactions . 

Background of the Invention 

Since the advent of the first electronic computers 
25 in the 1940's, computers have continued to handle a greater 
variety of increasingly complex tasks. Advances in 
semiconductors and other hardware components have evolved to 
the point that current low-end desktop computers can now handle 
tasks that once required roomfuls of computers. 

30 Computer programs, which are essentially the sets of 

instructions that control the operation of a computer to 
perform tasks, have also grown increasingly complex and 
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powerful. While early computer programs were limited to 

performing only basic mathematical calculations, current 
computer programs handle complex tasks such as voice and image 
recognition, predictive analysis and forecasting, multimedia 
5 presentation, and other tasks that are too numerous to mention. 

However, one common characteristic of many computer 
programs is that the programs are typically limited to 
performing tasks in response to specific commands issued by an 
operator or user. A user therefore must often know the 
10 specific controls, commands, etc. required to perform specific 
tasks . As computer programs become more complex and feature 
rich, users are called upon to learn and understand more and 
more about the programs to take advantage of the improved 
functionality. 

15 In addition to being more powerful, computers have 

also become more interconnected through private networks such 
as local area networks and wide area networks, and through 
public networks such as the Internet. This enables computers 
and their users to interact and share information with one 
20 another on a global scale. However, the amount of information 
is increasing at an exponential rate, which makes it 
increasingly difficult for users to find specific information. 

As a result of the dramatic increases in the both 
complexity of computer programs and the amount of information 
25 available to users, substantial interest has developed in the 
area of intelligent agent computer programs, also referred to 
as intelligent agents or simply agents, that operate much like 
software -implemented ^assistants]? to automate and simplify 
certain tasks in a way that hides their complexity from the 
30 user. With agents, a user may be able to perform tasks without 
having to know specific sequences of commands. Similarly, a 
user may be able to obtain information without having to know 
exactly how or where to search for the information. 

Intelligent agents are characterized by the concept 
35 of delegation, where a user, or client, entrusts the agents to 
handle tasks with at least a certain degree of autonomy. 
Intelligent agents operate with varying degrees of constraints 
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depending upon the amount of autonomy that is delegated to them 
by the user. 

Intelligent agents may also have differing 
capabilities in terms of intelligence, mobility, agency, and 
5 user interface. Intelligence is generally the amount of 
reasoning and decision making that an agent possesses. This 
intelligence can be as simple as following a predefined set of 
rules, or as complex as learning and adapting based upon a 
user's objectives and the agent's available resources. 

10 Mobility is the ability to be passed through a 

network and execute on different computer systems. That is, 
some agents may be designed to stay on one computer system and 
may never be passed to different machines, while other agents 
may be mobile in the sense that they are designed to be passed 
15 from computer to computer while performing tasks at different 
stops along the way. User interface defines how an agent 
interacts with a user, if at all. 

Agents have a number of uses in a wide variety of 
applications, including systems and network management, mobile 
20 access and management, information access and management, 
collaboration, messaging, workflow and administrative 
management, and adaptive user interfaces. Another important 
use for agents is in electronic commerce, where an agent may 
be configured to seek out other parties such as other users, 
25 computer systems and agents, conduct negotiations on behalf of 
their client, and enter into commercial transactions. 

Just as human agents have a certain amount of 
autonomy, intelligent agents similarly have a set of 
constraints on what they are authorized and not authorized to 
30 do. For example, a selling agent for electronic commerce 
applications may be constrained by a minimum acceptable price. 
However, a good selling agent, whether electronic or human, 
would never initially give its lowest acceptable price, as this 
would minimize profit margins. Furthermore, giving the lowest 
35 price may not even assure sales because a buyer may infer that 
the price is not competitive because the agent is unwilling to 
lower the price from the original offer. Therefore, an agent 
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typically starts negotiations with some margin from its worst 
case acceptable price, then works toward a mutually acceptable 
price with the other party. 

It is desirable for all agents, and particularly 
5 those in electronic commerce applications, to operate reliably, 
efficiently, and profitably on behalf of their clients. Any 
negotiation plans, techniques or strategies used by an 
intelligent agent to operate within its constraints, however, 
often should be hidden from other parties. Otherwise, the 
10 agent is placed at a competitive disadvantage. Given that many 
agents may be dispatched to unsecured environments, an 
assumption must be made that other parties may be able to scan 
or reverse engineer an agent to learn its negotiation strategy 
or other constraints. It must also be assumed that other 
15 parties may be able to decode messages sent between an agent 
and its client to obtain the greatest advantage in negotiation. 
The validity of such assumptions stems from the fact that these 
techniques are conceptually similar to many of the techniques 
used by some salespeople to obtain the best price possible. 

20 If a selling agent uses a predictable algorithm to 

make offers, e.g., starting with a comfortable margin and 
halving the difference between the previous asked price and its 
lowest price with each new asked price, the other party may be 
able to detect this trend and predict the lowest price 
25 acceptable to the agent. Under these circumstances, the 
selling agent would rarely be able to negotiate a price higher 
than its minimum acceptable price. 

Another desirable trait for intelligent agents is 
that of efficiency. In electronic commerce applications 
30 especially it is often desirable to maximize the number of 
trades at the best prices for the client. Any time that an 
intelligent agent spends in fruitless negotiations decreases 
the efficiency of the agent. 

Furthermore, another concern with intelligent agents 
35 arises when the agents are interacting with unknown parties. 
For example, if agents interact with known, reliable agents, 
the relative risks to the agents may not be as great, and the 
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agents may not be required to protect against adverse 
activities on the part of these parties. However, particularly 
in many unsecured environments, it is likely that the agents 
will interact with a number of unknown parties, which presents 
greater risks to the agents, and may require additional 
protections to be provided for the agent. 

In addition, intelligent agents in electronic 
commerce applications must often be capable of determining a 
reasonable or acceptable value for a desired transaction. In 
many markets, especially those that are electronically 
controlled, market conditions can change rapidly. Stock, bond 
and commodity prices for example change continuously, and an 
agent which works with outdated information may enter into 
transactions that are well outside of the current market 
conditions at the time of the transactions. Moreover, some 
markets may be subject to manipulation by other parties 
attempting to obtain competitive advantages. 

Therefore, a significant need exists in the art for 
an intelligent agent having productive, adaptive, secure and 
efficient negotiation skills for conducting commercial 
transactions on behalf of a client. 


Summary of the Invention 

The invention addresses these and other problems 
associated with the prior art in providing an intelligent agent 
25 and method of negotiating therewith which utilizes one or more 
features, alone or in combination, to enhance the productivity, 
security, efficiency and responsiveness of the agent in 
negotiations with other parties. 

Consistent with one aspect of the invention, the 
30 negotiation strategy of agents may be disguised from other 
negotiating parties to prevent such parties from gaining 
negotiating advantages at the expense of the agents . Such 
agents generate offers, wait for responses from negotiating 
parties, and determine based upon responses whether to complete 
35 transactions. A characteristic of at least one of the above 
steps may be randomized to make the agents' negotiation 


- 5 - 



WO 98/43146 


PCT/US98/04878 


* 


strategies less predictable, thereby limiting or even 
precluding negotiating parties from determining the agents' 
negotiation strategies therefrom. 

Consistent with an additional aspect of the 
5 invention, the efficiency of some agents may be improved by 
limiting negotiations that are likely to be unproductive. Such 
agents generate offers, wait for responses from negotiating 
parties, and determine based upon the responses whether to 
complete transactions. Unproductive negotiations with such 
10 agents are limited by constraining a characteristic of at least 
one of the above steps based upon the behavior of the 
negotiating party and/or the duration of the transaction. 
Negotiations with suspect or uncooperative parties, or which 
are prolonged beyond acceptable durations, are more likely to 
15 be terminated, thereby often freeing up the agents to seek more 
productive negotiations elsewhere. 

Consistent with another aspect of the invention, 
other parties with which an agent interacts may be identified, 
e.g., to modify the behavior of an intelligent agent depending 
20 upon a party with which the agent is interacting. Records of 
known parties may be maintained with one or more attributes 
associated therewith, so that upon interaction with an unknown 
party, the attributes therefor may be compared with those of 
the known parties to identify the unknown party as that known 
25 party for which the attributes most closely match. 
Identification of another party may have numerous benefits, 
including but not limited to being able to associate 
reliability ratings with given known parties so that the 
reliability of an unknown party may be determined. 

30 Dynamic value determination may also be relied upon 

to generate a value for a desired transaction, e.g., for the 
purpose of assisting an agent in calculating offers or 
determining whether an offer from another party is within an 
acceptable range for the given goods or services that are the 
35 subject of a desired transaction. Consistent with a further 
aspect of the invention, the desired values of desired 
transactions may be dynamically determined at least in part by 
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weighting estimated values from a plurality of information 
sources based upon a predetermined criteria to generate 
weighted estimated values, and normalizing the weighted values. 
By utilizing a plurality of information sources, an inherently 
5 more reliable value determination may be made for use by an 
agent in negotiations . Also, in many situations, manipulation 
of an agent's behavior by third parties may be minimized since 
value determinations are often not reliant on single sources 
of information. 

10 Consistent with another aspect of the invention, the 

desired values of desired transactions may also be dynamically 
determined at least in part by weighting the values of related 
transactions based upon the proximity of the related 
transactions to the desired transactions, and then normalizing 
15 the weighted values. The proximity of related transactions may 
be determined by comparing one or more characteristics of the 
desired and related transactions such that related transactions 
that are more similar to the desired transaction are weighted 
more heavily in the determination of the desired value. 

20 These and other advantages and features, which 

characterize the invention, are set forth in the claims annexed 
hereto and forming a further part hereof. However, for a 
better understanding of the invention, and of the advantages 
and objectives attained through its use, reference should be 
25 made to the Drawing, and to the accompanying descriptive 
matter, in which there is described illustrated embodiments of 
the invention. 

Brief Description of the Drawing 

FIGURE 1 is a block diagram of a networked computer 
30 system for use with the various embodiments of the invention. 

FIGURE 2 is a block diagram of one embodiment of the 
networked computer system of Fig. 1, illustrating the 
interaction between intelligent agents therein. 

FIGURE 3 is a block diagram of one embodiment of the 
35 networked computer system of Fig. 1, illustrating the primary 
components of the client and remote systems. 
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FIGURE 4 is a block diagram of an intelligent agent 
consistent with the principles of the invention. 

FIGURE 5 is a flowchart illustrating the program flow 
of an agent negotiation routine consistent with the invention. 

5 FIGURE 6 is a flowchart illustrating the program flow 

of the compute offer price block in Fig. 5. 

FIGURE 7 is a flowchart illustrating the program flow 
of the calculate offer duration block of Fig. 5. 

FIGURE 8 is a flowchart illustrating the program flow 
10 of the complete transaction determination block of Fig. 5. 

FIGURE 9 is a flowchart illustrating the program flow 
of the counteroffer determination block of Fig. 5. 

FIGURE 10 is a flowchart illustrating an agent 
identification routine consistent with the invention. 

15 FIGURE 11 is a block diagram of the transaction value 

determination block of Fig. 6. 

FIGURE 12 is a block diagram of the history value 
estimating block of Fig. 11. 

FIGURE 13 is a block diagram of the supply and demand 
20 value estimating block of Fig. 11. 

FIGURE 14 is a flowchart illustrating a high pass 
filter consistent with the invention. 

Detailed Description of the Illustrated Embodiments 

Turning to the Drawing, wherein like parts are 
25 denoted by like numbers throughout the several views, Fig. 1 
illustrates a networked computer system 10 for use with the 
illustrated embodiments of the invention. System 10, which is 
representative of many networked data processing systems, 
generally includes one or more computer systems, e.g., single- 
30 user computer systems 16, 18 and multi-user computer systems 
20, 60, coupled through a network 15. Multi-user computer 
system 20 typically includes one or more servers 25 to which 
one or more single-user computers 22 may be networked through 
a separate network 24. Similarly, multi-user computer system 
35 60 typically includes one or more servers 65 coupled to one or 

more single-user computer systems 62 through a network 64. 
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Network 15 may represent any type of networked interconnection, 
including but not limited to local-area, wide-area, wireless, 
and public networks (e.g., the Internet). 

Intelligent agents are computer programs which have 
5 been delegated a degree of autonomy but which are limited to 
operating within constraints defined by their client. A subset 
of such agents which are capable of being passed between and 
operating in different applications or computer systems are 
referred to as mobile agents. 

10 It is anticipated that agents consistent with the 

invention may originate in and be resident from time to time 
on any of the above-mentioned computer systems. One possible 
distinction between the computer systems for the purposes of 
the invention may be whether each is a client or a remote 
15 system relative to a particular agent. For example. Fig. 2 
illustrates an embodiment of computer system 10 where multi- 
user computer system 20 is a client system, and multi-user 
computer system 60 is a remote system. 

A client system will hereinafter refer to a computer 
20 system that provides an agent a certain level of security from 
manipulation by other parties when the agent is resident on the 
system. The client system is also the computer system from 
which management of the agent is typically handled. The agent 
typically but not necessarily will also originate from the 
25 client system. 

A remote system, on the other hand, will hereinafter 
refer to a computer system that is typically not capable of 
providing a desired level of security for an agent, generally 
because the computer system is not under the control of the 
30 client. It is typically while resident on a remote system that 
an agent runs the greatest risk of being scanned or reverse 
compiled, or of having communications intercepted or monitored, 
by other parties. 

The various embodiments described herein have 
35 principal uses in electronic commerce applications, where 

agents are configured to negotiate commercial transactions, 
generally in the role of buying or selling agents. The agents 
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may negotiate with other agents, other computer systems, or 
even other individuals. The agents may interact one-on-one, 
or may be capable of operating within a Jpmarket)? of multiple 
agents, along the lines of a stock or commodity market. 

5 Computer systems having the ability to host agents for 
interaction therebetween include negotiating programs of 
varying sophistication and are hereinafter referred to as agent 
hosts . 

For example, Fig. 2 illustrates a mobile intelligent 
10 agent 100 which communicates with an agent manager 32 in client 
system 20. During negotiation with another party such as 
negotiating agent 95, mobile agent 100 is resident on remote 
system 60. It should be appreciated that remote system 60 may 
be the client for agent 95, or may also be considered to be 
15 remote relative to this agent as well. 

An exemplary functional design of networked computer 
system 10 for implementing the various embodiments of the 
invention is illustrated in Fig. 3. Server 25 of client system 
20 generally includes a central processing unit (CPU) 28 
20 coupled to a memory 30 and storage 40 over a bus 54. A local 
area network interface is provided at 52, and an interface to 
remote system 60 over external network 15 is provided through 
interface 50. Agent manager program 32 is resident in memory 
30. Storage 40 includes one or more agents 42 (of which may 
25 include agent 100, for example), which are computer programs 
or modules that may be retrieved and used locally within system 
20, or dispatched to remote systems to execute and perform 
tasks on behalf of the client system. Storage 40 also includes 
an agent mission database 44 which may track agent operations 
30 and the relative success or failure thereof. 

Server 65 of remote system 60 also includes a CPU 68 
coupled to a memory 70, storage 80, external network connection 
90 and local network connection 92 over a bus 94. An agent 
host program 72 is resident in memory 70 to handle interactions 
35 between agents resident in the remote system. Typically, the 
agent host program is an asynchronous message/event driven 
environment that provides a common platform over which agent 
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computer programs execute and interact, much like an operating 
system. The agent host is also capable of permitting messages 
to be sent between agents and their clients. Memory 70 also 
includes a negotiating program 74 which operates as the pother 
5 party!? in transactions with agent 100, which may be another 
agent, a market or bulletin board application, or even an 
interface program through which an individual interacts with 
agent 100. Storage 80 maintains a transaction history database 
82 which logs the transactions completed on the server. 

10 Servers 25, 65 may be, for example, AS/400 midrange 

computers from International Business Machines Corporation. 
However, it should be appreciated that the hardware embodiments 
described herein are merely exemplary, and that a multitude of 
other hardware platforms and configurations may be used in the 
15 alternative. 

Moreover, while the invention has and hereinafter 
will be described in the context of fully functioning computer 
systems, those skilled in the art will appreciate that the 
various embodiments of the invention are capable of being 
20 distributed as a program product in a variety of forms, and 
that the invention applies equally regardless of the particular 
type of signal bearing media used to actually carry out the 
distribution. Examples of signal bearing media include but are 
not limited to recordable type media such as floppy disks, hard 
25 disk drives, and CD-ROM's, and transmission type media such as 
digital and analog communications links. 

Fig. 4 illustrates agent 100 in greater detail. In 
general, any agent must have the ability to sense, recognize 
and act. Common with many agents, agent 100 includes a number 
30 of operational components, including an engine 102 which 
controls the overall operation of the agent and functions as 
the Jpbrainsl? of the agent, a knowledge component 104 in which 
information is stored that is representative of the acquired 
knowledge of the agent, and an adapters component 106 through 
35 which the agent communicates with external objects (e.g., host 
objects 110) and through which the agent psensesp and interacts 
with its environment. A library component 105 persistently 
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stores in one or more libraries or databases the information 
utilized by knowledge component 104, while an optional view 
component 108 provides the human interface, if any, for the 
agent, e.g., for supplying instructions to the agent. 

5 It should be appreciated that all of the modules in 

agent 100 are typically provided within a single self- 
sufficient block or package of program code that permits the 
entire code for the agent to be transmitted to various 
locations and execute with a degree of autonomy from its 
10 client. Additional data or instructions may also be received 
by an agent from external sources, e.g., to supplement the 
library module as necessary. In addition, it should be 
appreciated that agent 100 may be implemented in practically 
any programming language, and is particularly well suited for 
15 object-oriented programming systems by virtue of its at least 
partially -autonomous operation. For example, agent 100 may be 
implemented as a Java package, which has a number of benefits 
for mobile program code by virtue of its platform- independence 
and run-time security. 

20 As illustrated in Fig. 4, a number of modules or 

objects, including agent negotiation module 118 and value 
determination module 200, are incorporated into engine 102 to 
handle the negotiation functions for the agent. Module 118 
generally implements the negotiation strategy for the agent, 
25 while routine 200 is utilized by module 118 to dynamically 
determine the value of a desired transaction. Each of these 
modules will be discussed separately herein. 

It should be appreciated that other routines or 
objects necessary to implement the agent are also included in 
30 engine 102 but are not shown herein for ease of illustration. 
For example, functions such as initialization, communications, 
maintenance, finding other agents or markets to interact with, 
etc. may also be utilized. However, as these functions relate 
more to the basic operation of an agent, which is in general 
35 known in the art, these functions will not be discussed in any 
greater detail herein. 
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Moreover, additional functionality may be implemented 
by agent 100, e.g., disguising communications between an agent 
and agent manager, and disguising agent decision logic through 
the use of neural networking, as described in U.S. Patent 
5 Application Serial No. 08/822,119 entitled "APPARATUS AND 

METHOD FOR COMMUNICATING BETWEEN AN INTELLIGENT AGENT AND 
CLIENT COMPUTER PROCESS USING DISGUISED MESSAGES", which has 
been incorporated by reference. Agent 100 may also be one of 
several agents having varying degrees of domain knowledge, or 
10 may have multiple modules with varying degrees of domain 

knowledge, so that the agent may be optimized for operation in 
different situations based upon an objective criteria (e.g., 
security concerns), as described in U.S. Patent Application 
Serial Nos. 08/826,107 and 08/822,993, respectively entitled 
15 APPARATUS AND METHOD FOR OPTIMIZING THE PERFORMANCE OF COMPUTER 
TASKS USING MULTIPLE INTELLIGENT AGENTS HAVING VARIED DEGREES 
OF DOMAIN KNOWLEDGE" and "APPARATUS AND METHOD FOR OPTIMIZING 
THE PERFORMANCE OF COMPUTER TASKS USING INTELLIGENT AGENT WITH 
MULTIPLE PROGRAM MODULES HAVING VARIED DEGREES OF DOMAIN 
20 KNOWLEDGE", which have also been incorporated by reference. 

Agent Negotiation 

Agent negotiation with agent negotiation module 118 
incorporates a number of separate features usable alone or 
together to improve the performance of an agent when conducting 
25 negotiations. First, one or more operating parameters of the 
agent may be randomized to an extent to reduce predictability 
and thus hinder the ability of other parties (e.g., other 
agents, computer programs, or individuals) to determine the 
negotiation strategy of the agent. Second, one or more 

30 operating parameters of the agent may be constrained to an 
extent to limit unproductive negotiations, typically based upon 
the duration of the negotiations and/or the behavior of the 
other parties to the negotiations. In addition, in some 

embodiments, these features, as well as other features 
35 discussed below, may obstruct attempts by other parties to 
manipulate the negotiations. 
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Fig. 5 illustrates an agent negotiation routine 120 
which describes the operation of agent negotiation module 118 


in greater detail. Routine 120 is generally called when agent 
100 has found another party with which to negotiate, and the 
routine receives a desired transaction, typically from the 
agent manager in the client system. Routine 120 has been 
genericized for either a buying agent or a selling agent, with 
the distinctions in the routine for each type of agent pointed 
out below. in general, it should be appreciated that the 
negotiation strategies for buying and selling agents differ to 
the extent that a buying agent's goal is typically to achieve 
the lowest price possible, while the selling agent's goal is 
typically to achieve the highest price possible. 

First, in block 122, a compute offer price block 122 
is executed to generate an offer price for a desired 
transaction. Next, in block 124, an offer at the computed 
price is issued to another party (e.g. , another agent, computer 
program such as a market, an individual, etc.), typically by 
sending a message. 

It should be appreciated that agents typically 
operate asynchronously, whereby a response message from the 
other party, if any, may arrive at any time after the offer has 
been made. Thus, to prevent agent 100 from hanging up waiting 
for a response that may never arrive, an offer duration is 
calculated in block 126 and a timer is set in block 127 to fix 
the maximum time for agent 100 to wait for a response. 

Next, in block 128, agent 100 waits for the first of 
the expiration of the timer or the receipt of a response 
message from the other party. It should be appreciated by 
those of skill in the art that while agent 100 waits for a 
response from the other party, the agent may suspend other 
operations, or may continue performing other operations during 
the offer duration period. For example, in one embodiment, 
receipt of a response or expiration of the timer may generate 
an interrupt which diverts execution of agent 100 to handle the 
either situation as appropriate. Also, in another embodiment, 
agent 100 may be multithreaded with a separate thread executing 


- 14 - 



WO 98/43 1 46 PCT/US98/04878 

for each negotiation session, whereby each thread may be 
permitted to simply wait for a response until the timer expires 
without having to suspend the overall operations of the agent. 
Moreover, in other embodiments, received responses may be 
5 separately logged, with the agent checking for responses only 
periodically and/or upon expiration of the timer. It should 
also be appreciated that the offer duration may vary 
significantly for different applications. For example, in some 
applications, e.g., stock market transactions, offer durations 
10 as short as one or more computer cycles may be possible. In 
other applications, e.g., real estate transactions, offer 
durations may be as long as days, weeks, months or longer. 

If no response is received within the duration of the 
offer, control passes to block 130 to withdraw the offer (if 
15 necessary) and complete or terminate the negotiation. An offer 
may be withdrawn by sending an appropriate message to the other 
party, removing the offer from a market situation (e.g., if a 
^bulletin boardh of offers has been set up) , or simply 
terminating the negotiation. A negotiation complete situation 
20 generally indicates that agent 100 is free to wait for other 
offers from other parties, or to seek out other parties with 
which to negotiate. 

If a response message is received from the other 
party, control passes to block 132 to determine whether to 
25 complete the transaction (i.e., make a trade or £>close a 

dealt) . If the response message indicates an acceptable 
response, control passes to block 134 to complete the 
transaction, e.g., by sending an appropriate message to the 
other party, notifying an agent host of the transaction 
30 specifics, sending a message to the client requesting 

authorization or indicating that the transaction has been 
completed, etc. 

if, however, an unacceptable response is received, 
control passes to block 136 to determine whether to 
35 counteroffer -- that is, whether to continue negotiations. If 
it is determined that no counteroffer should be made, routine 
120, and the negotiation with the other party, is complete. 
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In addition, any messages to the other party, the agent host, 
and/or the client indicating the completion of negotiations may 
be made as required. 

If a counteroffer is to be made, control passes to 
5 block 138 to calculate a wait time before which a counteroffer 
is to be made, then to block 139 to wait for the calculated 
period of time before returning control to block 122 to compute 
and issue a new offer, or counteroffer. in the alternative, 
no wait time may be utilized, resulting in an immediate 
10 counteroffer being issued. 

It should be appreciated that agent 100 may conduct 
negotiations with more than one other party at a time, whereby 
the program flow similar to that shown in Fig. 5 would be 
executed for each negotiation session. Each negotiation 
15 session may be executed using a separate execution thread or 
other context switching mechanism. 

As discussed above, one or more operating parameters 
of routine 120 are randomized and/or constrained to improve the 
negotiation performance of agent 100. In the illustrated 
20 embodiment of Fig. 5, the computation of the offer price in 
block 122, the calculation of the offer duration in block 126, 
the determination of whether to complete the transaction in 
block 132, the determination of whether to make a counteroffer 
in block 136, and the calculation of a wait time in block 138 
25 are randomized to disguise negotiation strategy and/or are 
constrained to limit unproductive negotiations. It should be 
appreciated, however, that randomizing and/or constraining any 
of these operating parameters may be omitted, and that other 
operating parameters may be randomized and/or constrained 
30 consistent with the invention. 

The steps performed in compute offer price block 122 
are illustrated in greater detail in Fig. 6. Block 122 
maintains a record of previous calculations of the value of the 
desired transaction, as well as previous asked (selling 
35 agent's) prices and previous bid (buying agent's) prices. 
These values are used to vary the agent’s offer price for each 
subsequent counteroffer made by the agent. 
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First, block 140 determines the value (v) of the 
desired transaction, i.e., what the agent considers to be the 
actual value of the goods or services being purchased, or what 
the agent considers to be a }?fair]? price for its client. One 
5 suitable process for determining the value is performed in a 
value determination module 200 discussed in greater detail 
below in connection with Figs. 11-13, although other processes 
may be used in the alternative. 

Next, blocks 142 and 144 may be executed to adjust 
10 the previous asked (selling agent's) price and previous bid 
(buying agent's) price in view of any changes to the determined 
value of the desired transaction. Consequently, if agent 100 
detects a significant change between the determined value for 
the current iteration and for a previous iteration, the values 
15 stored for the previous asked and bid prices may be adjusted 
accordingly to reflect the new value of the transaction. 
Therefore, for an iteration n of agent negotiation routine 120, 
blocks 142 and 144 may be represented as: 

A n -i = A n . l 0 i d + (V n - Vn.j) 

20 B n l = B n . i ,oid + (V n - V,,.,) 

where A„., is the previous asked price after adjustment, B,,.! 
is the previous bid price after adjustment, A n l old is the 
previous asked price prior to adjustment, B n . li0ld is the 
previous bid price prior to adjustment, V n is the current 
25 determined value of the desired transaction, and V nl is the 
previous determined value. 

It should be appreciated that blocks 140-144 may 
not be executed during the first iteration of agent 
negotiation routine 120. Moreover, it may not be necessary 
30 to ever execute these blocks in certain applications, 
particularly where the negotiations occur over a short time 
frame and/or the market for the desired transaction is such 
that variations in the value are not expected during 
negotiations . 
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After the previous asked and bid prices are 
adjusted, an optional block 145 may be executed to attempt 
to detect the real price of the other party with which 
negotiations are being conducted. A number of methods of 
5 detecting the other party's real price may be used, 
typically utilizing a curve fitting algorithm to extrapolate 
the other party's previous offers to find the real price, or 
the best price (relative to agent 100) at which the 
transaction may be completed. 

10 For example, another party may attempt to approach 

the real price by reducing the difference between the 
current offer and the real price by a fraction each time. 
By tracking each offer, data points over time may be fit to 
a curve to minimize mean square error or root mean square 
15 error, e.g., with the curve represented by: 

P n = R + (P 0 - R) x e' cn 

E = 3 (Y n P n ) 2 

where R is the real price, Y„ are the offers, P n are the 
values for the offers predicted by the curve, C is a 
20 constant, and E is the error. It should be appreciated that 
R, P„ and c are adjusted to minimize the error. 

The above equations assume that the offers are 
approaching a constant real price. If the real price is 
changing over time due to appreciation or depreciation or 
25 other factors, the equation for P n may be varied accordingly. 

Also, the equation assumes that the offers occur at fixed 
time intervals, and if they do not, the equation may also be 
varied accordingly by substituting a time variable t for 
interval variable n. The error may also be minimized based 
30 upon either or both of the n and t domains, with the domain 
giving the least error used in detecting the real price. 

Other curve fitting techniques may be used in the 
alternative. Other equations may also be used to compute 
the predicted value for P n . in addition, a neural network 
35 may be used to predict the other party's real price. For 


- 18 - 



WO 98/43146 


PCT/US98/04878 


example, it would not be uncommon for another party's 
negotiation strategy to rely on the offers issued by agent 
100 when computing the next offer for the party. In such 
circumstances, the offers issued by agent 100 may also be 
5 used as data points to predict the real price. For example, 
if agent 100 is a buying agent, the following equations may 
be used: 

P sn = R + (P 8 o ' R) x e' cn 
P bn = R + (R - P s o) x e cn 
10 E = 3 (Y sn - P sn ) 2 + 3 (Y bn - P bn ) 2 

where R is the real price, Y an are the sell offers, Y bn are 
the buy offers, P sn are the values for the sell offers 
predicted by the curve, P bn are the values for the buy offers 
predicted by the curve, C is a constant, and E is the error. 
15 On the other hand, if agent 100 is a selling 

agent, the following equations may be used: 

P bn = R + (P b0 - R) x e' cn 
P sn = R + (R - P b0 .) x e-“ 

E = 3(Y Bn - P Bn ) 2 + 3 (Y bn - P bn ) 2 

20 where R is the real price, Y sn are the sell offers, Y bn are 
the buy offers, P sn are the values for the sell offers 
predicted by the curve, P bn are the values for the buy offers 
predicted by the curve, C is a constant, and E is the error. 

It should be appreciated that the other party's 
25 real price may not be detectable, e.g., early in 
negotiations where sufficient data points have not been 
obtained, or if a more sophisticated negotiation strategy is 
being employed. Consequently, the use of the real price in 
determining the next offer for agent 100 in block 145 may be 
30 omitted in these circumstances. 

Next, blocks 146 and 148 are executed to calculate 
(for a buying agent) maximum and minimum bid prices or (for 
a selling agent) maximum and minimum asked prices. The 
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maximum and minimum prices represent a range of acceptable 
prices for which an offer may be made by the agent. 

For a buying agent, the maximum and minimum bid 
prices may be selected to be: 

5 max = MIN (V n - P, A,,.!, R) 

min = MAX (V„ - P - M, B„.!) 

where P is the required (or minimum) profit which the agent 
must obtain to complete the transaction, and M is the 
negotiating margin used as a starting point for 
10 negotiations. Both of these values may be provided as input 
to the agent and act as constraints on the agent's behavior. 

Moreover, it should be noted that the maximum bid 
price is constrained by the real price, if any, detected for 
the other party, since at this point it is known that the 
15 other party is likely to accept an offer at this price. A 
margin may also be subtracted from the real price if it is 
anticipated that the other party may be willing to go below 
the real price. If the real price is not detected, this 
term may be dropped from the maximum bid price calculation. 
20 For a selling agent, the maximum and minimum asked 

prices may be selected to be: 

max = MIN (V n + P + M, A,^) 
min = MAX (V n + P, B n l , R) . 

Moreover, it should be noted that the minimum 
25 asked price is constrained by the real price, if any, 
detected for the other party, since at this point it is 
known that the other party is likely to accept an offer at 
this price. A margin may also be added to the real price if 
it is anticipated that the other party may be willing to go 
30 above the real price. If the real price is not detected, 
this term may be dropped from the minimum asked price 
calculation. 
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It should be appreciated that on the first 
iteration of agent negotiation, no previous asked and bid 
prices exist, and thus, the MIN and MAX functions simplify 
to their respective remaining terms . On subsequent 
iterations, however, the range of asked prices decreases, 
but not below that which would not provide the required 
profit for the selling agent. Also, the range of bid prices 
generally increases with each iteration, but never exceeds 
that which would not provide the required profit for the 
buying agent. 

Next, in block 149, a randomized offer price is 
calculated for the agent by selecting a random price between 
the minimum and maximum prices calculated in blocks 146 and 
148. For a buying agent, the offer price, or the current 
bid price, is set to: 

B n = min + random x (max - min) 

and for a selling agent, the offer price, or the current 
asked price, is set to: 

A„ = min + random x (max - min) 

where random is a random number between 0 and 1 . 

Therefore, a degree of random noise is added to 
the offer price computation, thereby hindering detection of 
the negotiation strategy. Moreover, the range of acceptable 
prices from which to select is also constrained with each 
successive iteration. Other pricing strategies may be used 
in the alternative. For example, the offer price may be 
selected (for a buying agent) by simply subtracting a fixed 
amount or a fixed percentage from the last asked price, or 
(for a selling agent) by adding a fixed amount or fixed 
percentage to the last bid price. In addition, in lieu of 
determining a value for the desired transaction, this 
information could be provided remotely to agent 100 by the 
agent manager. 
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Fig. 7 illustrates in greater detail the steps in 
calculate offer duration block 126 of Fig. 5. in this 
block, probability functions are used to calculate a random 
wait time constrained by the number of iterations (cycles) 
5 in the negotiation, as well as the last offer received from 
the other party. 

For a buying agent, block 150 is first executed to 
calculate a wait probability value, Pwait, between 0 and 1. 
As shown in the figure, Pwait is calculated to be the 
10 product of two probability functions, Pcycles and Pasked. 

Pcycles is a function which decreases from 1 to 0 as the 
number of cycles or iterations increases. For example, 
where C is the number of cycles, and C,^ is the maximum 
number of negotiation cycles permitted, one suitable 
15 function may be: 

Pcycles = 1 - (C/C^J . 

Pasked is a function which decreases from 1 to 0 
based upon A n . lf the last asked price received from the other 
party. The Pasked function may be replaced with a constant 
20 value or separate function during the first iteration when 
no previous asked price exists. Moreover, the Pasked 
function may be initialized after the first iteration (cycle 
C = 0) to span the range of the minimum bid price 

calculated, mino, to the first asked price from the other 
25 party, A 0 . A suitable function may be: 

Pasked = 1 - ( (A,,^ - min 0 )/(A 0 - min 0 ) ) . 

For a selling agent, block 152 is instead executed 
to calculate Pwait. In this block, Pwait is calculated to 
be the product of Pcycles and Pbid. Pcycles may be the same 
30 function as above in block 150. Pbid may be a function 
which increases from 0 to 1 based upon B n . lf the last bid 
price received from the other party. The Pbid function may 
be replaced with a constant value or separate function 
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during the first iteration when no previous bid price 
exists. Moreover, the Pbid function may be initialized 
after the first iteration (cycle C = 0) to span the range of 
the first bid price from the other party, B 0 , to the maximum 
5 asked price calculated, max 0 . A suitable function may be: 

Pbid = ((B n l - B„) / (max 0 - B 0 ) ) . 

It should be appreciated that Pwait tends to 
decrease as the number of cycles increases. Moreover, Pwait 
tends to be greater depending upon how Jpgoodl? the other 
10 party's offer is relative to the agent (i.e., for buying 
agents, lower offers from other parties result in higher 
Pwait values, and vice versa for selling agents) . These 
constraints tend to decrease the offer duration as time 
increases and/or if the other party does not appear to be 
15 converging toward an acceptable price for the agent. 

Any of the above functions may utilize different 
distributions to modify the performance of agent 100. For 
example, different linear, exponential, logarithmic, etc. 
functions may be utilized for any of Pwait, Pasked and Pbid, 
20 and may be implemented as functions, subroutines, or tables. 

In addition, none of the functions need be continuous or 
monotonically increasing or decreasing. 

After execution of block 150 or block 152, control 
passes to block 154 to create a probability triangle with a 
25 base from 0 to 1, with a peak at Pwait, and normalized to an 
area of 1. Next, in block 156, the triangle is integrated 
to get a Sigmoid function, and the function is subsequently 
inverted, resulting in a probability distribution that is 
weighted heavier proximate the value of Pwait. A random 
30 number between 0 and 1 is selected in block 157, and this 
number is input into the derived Sigmoid function in block 
158 and used to calculate a random offer duration time 
between maximum and minimum wait times, wait raax and wait mln . 

The maximum and minimum wait times are typically 
35 selected depending upon the particular circumstances of the 
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market in which the agent interacts (e.g., what is 
considered an acceptable offer duration in the real estate 
market is usually different than an acceptable offer 
duration in the stock market) . These times may also be 
5 controlled by user input if desired. 

It should be appreciated that other probability 
distributions may be used in the alternative. For example, 
instead of a probability triangle, other functions which 
either increase or decrease the distribution around Pwait 
10 may be used. In addition, block 126 may simply calculate a 
random offer duration with equal distribution in the range 
of acceptable wait times, or a fixed offer duration may be 
used. Moreover, an infinite offer duration may be used in 
some applications. However, block 126 as disclosed herein 
15 has the advantage of prolonging the offer duration for more 
promising negotiations, while shortening the duration when 
a negotiation does not appear to be as productive. 

Fig. 8 illustrates in greater detail the steps in 
determine whether to complete transaction block 132 of Fig. 
20 5. First, in block 160, the asked price is compared to the 

bid price. If the asked price is less than or equal to the 
bid price, this indicates that a suitable price for the 
transaction has been reached, and accordingly, control is 
returned to block 134 (Fig. 5) to complete the transaction. 
25 If the asked price is still greater than the bid price, 
control passes to one of blocks 162 or 164, depending upon 
whether agent 100 is a buying or selling agent. 

For a buying agent, block 162 is executed to 
calculate an accept probability value, Paccept, which is a 
30 number between 0 and 1 that represents the probability that 
agent 100 will accept the other party's last offer 
irrespective of the fact that its last offer was not fully 
agreed to. Paccept divides a probability range of 0 to 1 
into accept and reject portions, such that a random number 
35 selected in this probability range may fall into either the 
accept or reject portions to control whether the transaction 
will be completed. 
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Paccept is calculated as a product of two 
probability functions, Pcycles and Pasked. Pcycles may be 
an increasing function between 0 and 1, based upon C, the 
number of cycles or iterations, and the maximum number 

5 of cycles permitted in a negotiation: 

Pcycles = (C/C„ ax ) . 

Pasked may be a function which decreases from 1 to 
0 based upon A n , the current asked price received from the 
other party. The Pasked function may be a function of the 
10 current asked price between the current and maximum bid 
prices, B n and max, calculated in block 122 of Fig. 6. For 
example, one suitable function may be: 

Pasked = 1 - ( (A n - B n )/(max - B n ) ) . 

Consequently, the probability that the transaction 
15 will be completed increases over time, as well as depending 
upon how close the current asked and bid prices are. It 
should be noted that with this probability function the 
probability of accepting an offer above the max price 
calculated in block 122 is zero. 

20 For a selling agent, block 164 is instead executed 

to calculate Paccept as a product of Pcycles and another 
probability function, Pbid. Pcycles may be identical to 
that used in block 162. Pbid may be a function which 
increases from 0 to 1 based upon B„, the current bid price 
25 received from the other party. The Pbid function may be a 
function of the current bid price between the minimum and 
current asked prices, min and A n , calculated in block 122 of 
Fig. 6. For example, one suitable function may be: 

Pbid = ( (B n - min) / (A n - min) ) . 

30 Consequently, the probability that the transaction 

will be completed increases over time, as well as depending 
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upon how close the current asked and bid prices are. It 
should also be noted that with this probability function the 
probability of accepting an offer below the min price 
calculated in block 122 is zero. Furthermore, it should be 
5 appreciated that any of the above functions may utilize 
different distributions to modify the overall performance of 
agent 100, e.g., different linear, exponential, logarithmic, 
etc. functions, whether implemented as functions, 
subroutines, or tables. In addition, none of the functions 
10 need be continuous or monotonically increasing or 
decreasing . 

Next, a random number within a probability range 
of 0 to 1 is selected in block 166. This number is compared 
to Paccept in block 168. If the random number is less than 
15 or equal to Paccept, the last offer from the other party is 
accepted and control is passed to block 134 of Fig. 5. If 
the random number is greater than Paccept, the last offer is 
rejected, and control passes to block 136 of Fig. 5 to 
determine whether a counteroffer should be made. 

20 Other rules for completing a transaction may be 

used in the alternative. For example, a buying agent may be 
configured to accept any offer that is less than the initial 
asked price, or to accept only offers for the bid price or 
lower, or to accept any offer less than the maximum bid 
25 price. Similarly, a selling agent may be configured to 

accept any offer that is greater than the initial bid price, 
or to accept only offers for the asked price or higher, or 
to accept any offer greater than the minimum asked price. 

Fig. 9 illustrates in greater detail the steps in 
30 determining whether to counteroffer block 136 of Fig. 5. If 

agent 100 is a buying agent, block 170 is executed to 
calculate a counteroffer probability value, Pcounter, which 
is a number between 0 and 1 that represents the probability 
that agent 100 will continue negotiations by making a 
35 counteroffer. Pcounter divides a probability range of 0 to 
1 into counteroffer and no counteroffer portions, such that 
a random number selected in this probability range may fall 
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into either the portions to control whether a counteroffer 
will be made. 

Pcounter is calculated as a product of two 
probability functions, Pcycles and Pasked. Pcycles may be 
5 a decreasing function between 0 and 1, e.g., as with the 
Pcycles functions utilized in blocks 150 and 152 of Fig. 7. 
Pasked may be a function which decreases from 1 to 0 based 
upon A n , the current asked price received from the other 
party. For example, one suitable function may be: 

10 Pasked = 1 - ( (A n - B n )/(A„ ax - B n ) ) 

where A„ ax is a value that is typically greater than max and 
that represents the maximum asked price for which a 
counteroffer should be considered. A max may be, for example, 
a fixed percentage or constant above max, and may operate, 
15 for example, to detect frivolous offers that are beyond what 
should be expected for reasonable offers from another party. 

Consequently, the probability that a counteroffer 
will be made decreases over time to attempt to limit 
unproductive negotiations. Also, the probability that a 
20 counteroffer will be made increases depending upon how close 

the current asked and bid prices are. 

For a selling agent, block 172 is instead executed to 
calculate Pcounter as a product of Pcycles and another 
probability function, Pbid. Pcycles may be identical to 
25 that used in block 170. Pbid may be a function which 
increases from 0 to 1 based upon B n , the current bid price 
received from the other party. For example, one suitable 
function for Pbid may be: 

Pbid = ((B n - B mln ) / (A n - B nin )) . 

30 where B mln is a value that is typically less than min and that 
represents the minimum bid price for which a counteroffer 
should be considered. B mln may be, for example, a fixed 
percentage or constant below min, and may operate, for 
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example, to detect frivolous offers that are beyond what 
should be expected for reasonable offers from another party. 

As with blocks 150, 152, 162 and 164, any of the 
above functions in blocks 170 and 172 may utilize different 
5 distributions to modify the overall performance of agent 
100, e.g., different linear, exponential, logarithmic, etc. 
functions, whether implemented as functions, subroutines, or 
tables. In addition, none of the functions need be 

continuous or monotonically increasing or decreasing. 

10 Next, a random number between 0 and 1 is selected 

in block 174. This number is compared to Pcounter in block 
176. If the random number is less than or equal to 
Pcounter, a counteroffer will be made, and control is passed 
to block 138 of Fig. 5. If the random number is greater 
15 than Pcounter, no counteroffer will be made, and the 

negotiation may be terminated. 

Other manners of determining whether to make a 
counteroffer may be used. For example, counteroffers may 
always be made or never be made. In addition, counteroffers 
20 may be made only for a fixed number of cycles. Other 

alternatives will be apparent to one skilled in the art. 

Returning to Fig. 5, block 138 may also be 
randomized to disguise the negotiation strategy of agent 
100. Block 138 may calculate a wait time by retrieving a 
25 random number to select between a range of acceptable wait 
times, specified by min time and max time, each of which may 
be selected based upon the particular market characteristics 
within which the agent operates. A suitable function may 
be: 

30 wait time = min time + (max time - min time) x random# 

In the alternative, a constant wait time (even zero) may be 
used for block 138. In addition, a weighted function, 
similar to the offer duration calculation, may also be 
performed to vary the wait time in view of the duration of 
35 the negotiation and/or the behavior of the other party. 
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In general, it should be appreciated that 
randomization may be performed on any number of operational 
parameters or characteristics related to the negotiation 
strategy of agent 100, which effectively hinders the ability 
5 of other parties to detect the negotiation strategy of the 
agent. 

Also, a party's unpredictability in negotiations 
often leads to a more favorable outcome for the party 
because another party may be less likely to risk missing out 
10 on the transaction. For example, if it was known that agent 
100 routinely sets an offer duration of five days, another 
party knowing this may seek better offers for four days, 
knowing that the original offer will still be- available. 
However, if the offer duration is not known, the other party 
15 may simply accept the offer rather than risk losing it. 

Moreover, it should be appreciated that any number 
of operational parameters or characteristics may be 
constrained in the manner disclosed above based upon a 
variety of factors including duration of negotiation and 
20 behavior of another party. This provides a degree of 
stability for the agent since less productive negotiations 
are on the average terminated more quickly to enable the 
agent to seek more productive negotiations elsewhere. In 
addition, this may reduce manipulation by other competing 
25 parties which may attempt to tie the agent up with frivolous 
negotiations while the other parties complete transactions 
to the detriment of the agent. 

The behavior of agent 100 may also be constrained 
based upon the identification of another party or the 
30 perceived reliability or legitimacy of the other party, with 
a suitable probability function developed to limit 
negotiations with unreliable or unknown parties relative to 
known valid parties. For example, one suitable manner of 
identifying another agent is illustrated by agent 
35 identification routine 180 in Fig. 10. With this routine, 
a database of known agents may be utilized, with 
characteristics of an unknown agent compared against the 
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database to match an unknown agent to one of the unknown 
agents . 

Routine 180 begins at block 181 by collecting 
information about an unknown agent in the form of one or 
5 more attributes. For example, routine 180 may attempt to 
obtain such information on an unknown agent as its name or 
identification, its client, bank and/or bank account number, 
its homebase location (e.g., IP address or domain), the name 
or identification of the agent program, the size of the 
10 agent program, where messages and other communications with 
the agent originate, and/or the pattern of input/output 
(I/O) compared to CPU cycles for I/O transmissions. Also, 
routine 180 may attempt to retrieve a credit card number or 
bank account number from the unknown agent and validate the 
15 number. Moreover, the unknown agent may be scanned and 

compared to other known agents, e.g., comparing the 
percentage of identical code, determining the language the 
agent was written in, or searching for unique patterns in 
much the same manner as a virus checking program. 

20 Whatever attributes are selected for analysis of 

unknown agents, each factor is assigned a weighting factor 
such that the sum of all weighting factors equals one. 
Then, in blocks 182-186, a loop is executed to compare all 
of the attributes retrieved for the unknown agent against a 
25 known agent stored in the database. In block 182, the 

attributes for a known agent are retrieved, and in blocks 
183-186, each attribute for the unknown agent is compared 
with the corresponding attribute for the known agent. If 
any attributes match, their corresponding weighting factors 
30 are accumulated by block 185. 

Next, in block 187, the accumulated weighting 
factor is compared with a minimum threshold that represents 
the smallest weighting factor that could indicate a match 
with a known agent. If the threshold is exceeded, block 188 
35 compares the accumulated weighting factor with the previous 
maximum for the agent being analyzed (which is initially set 
to zero) . If the accumulated weighting factor exceeds the 
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previous maximum (indicating a more likely match) , the 
identification of the known agent and the accumulated 
weighting factor are stored as the new maximum in block 189. 
If either the minimum threshold or the previous maximum are 
5 not exceeded, block 189 is skipped. 

Next, block 190 determines whether the unknown 
agent must be compared to any additional known agents in the 
database. If so, control passes to block 182 to compare the 
unknown agent to the next known agent in the database. If 
10 all known agents have been processed, control passes to 
block 191 to report the known agent identification and 
accumulated weighting factor therefor before terminating the 
routine. 

In some embodiments of the invention, some of the 
15 records of known agents may represent categories of known 
agents, where one or only a few attributes are emphasized. 
This would permit, for example, agents that emanated from a 
known corrupt domain to be specially handled irrespective of 
other attributes, among other special situations. 

20 Based upon the information provided by routine 

180, a negotiation routine consistent with the invention may 
be able to classify an unknown agent as valid, corrupt, 
unknown, or may define a distribution of reliability from 
valid to corrupt. Based upon this classification, one or 
25 more negotiation characteristics may be constrained as above 
with routine 120, or even terminated immediately in some 
applications. In addition, the results of a negotiation 
with a particular agent may be fed back to the database of 
known agents to modify the reliability of the known agents 
30 and thereby expand and improve the database as the agent 
gains experience. For example, a neural network could be 
used to generate a reliability rating for an agent based 
upon the learned behavior of known agents. 

Other functionality to the described agent 
35 negotiation routine may be made consistent with the 
invention. Moreover, it should be appreciated that any of 
the above functionality may be shifted to the agent manager, 
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whereby part or none of the negotiation strategy is resident 
in the agent, and therefore the agent operates to a greater 
extent as a intermediary between the agent manager and the 
other party. 

5 Value Determination 

The value of a desired transaction may be 
determined dynamically by agent 100 in part by combining 
value estimates from one or more sources of information. 
Multiple value estimates may be combined, for example, by 
10 taking the weighted average of the value estimates, although 
other methods may be used consistent with the invention. 
Moreover, as will be discussed in greater detail below, the 
value of a desired transaction may also be determined at 
least in part by generating a value estimate from a 
15 plurality of related transactions, whether current or past 
transactions, based upon their proximity to a desired 
transaction. By comparing one or more characteristics of 
the desired and related transactions, related transactions 
that . are more similar to the desired transaction are 
20 weighted more heavily and therefore are more prominently 
reflected in the determination of the value estimate. 

The valuation process described herein may be 
performed once for a negotiation, or may be performed as 
often as once each iteration in a negotiation, to ensure 
25 that the latest information is used to obtain the best deal 
for the client. From the value retrieved from this process, 
an offer price may be determined by adding or subtracting a 
negotiating margin and/or required profit margin as 
appropriate. 

30 Fig. 11 illustrates a dynamic value determination 

module 200, which includes and maintains four databases 
which provide four types of sources of information for 
estimating the value of a desired transaction input to the 
module. As will become more apparent from the discussion 
35 below, different databases may have greater applicability to 
different markets, as well as different goods and services, 
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and thus, the four databases disclosed herein may not be 
required for all applications. Other types of databases may 
also be relied upon consistent with the invention. 

A first database, base values and delta values 
5 database 202, is analogous to an automotive buyers guide, 
where goods have base values which may be adjusted by delta 
values depending upon one or more optional features for the 
particular goods. For example, with an automotive buyers 
guide, automobiles may have base wholesale and retail 
10 prices, with delta prices for adjusting the base prices 
depending upon mileage and optional equipment. 

A second database, rules for computing value 
database 204, may be used for more complicated applications 
where values may not be defined with a simple database such 
15 as database 202. For example, for real estate, a suitable 
database may be implemented with rules such as price per 
square footage, location information and style of house, 
plus variable additions and subtractions for certain 
characteristics. Rules -based databases are in general known 
20 in the art, and may vary greatly depending upon the 

particular goods and services, and/or market involved. 

A third database, history of transactions database 
206, maintains a record of past transactions, including the 
price of the transaction as well as such descriptive 
25 information as the type, quantity, and time of the 

transaction, as well as the parties involved in the 
transaction. A fourth database, current market status 
database 208, maintains current market information, 

including the current prices (e.g., asked and bid prices) 
30 for certain transactions, as well as any limitations on the 
prices such as quantity and other descriptive information. 
The current market information includes a record of current 
transactions, which may include recent completed 
transactions and/or uncompleted transactions such as 
35 outstanding buy and sell offers. 

Databases 202 and 204 are often fairly stable and 
may need only be updated periodically from an external 
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source (e.g., many automobile buyers guides are updated 
monthly, quarterly or yearly) . However, databases 206 and 
208 are often more dynamic and may need to be updated almost 
continuously to provide agent 100 with the latest 
5 information possible. 

In the illustrated embodiment, updating of 
databases 206 and 208 is performed via a separate market 
monitoring agent 260, which may obtain information via 
maintaining a transaction history for all agents at a home 
10 base, snooping on a network such as the Internet, accessing 
public sources such as libraries, newspaper, financial 
market or government records, etc. It should be appreciated 
that market monitoring may also be handled by the agent 
manager in the client system, or even by agent 100 itself. 
15 Market monitoring agent 260 would operate principally as a 
data mining or information retrieval agent. The operation 
of such monitoring agents is generally known in the art, and 
therefore agent 260 will not be described in any greater 
detail herein. 

20 Based upon the information from databases 202-208, 

value estimates for a desired transaction may be obtained 
from one or more of four value estimators. The desired 
transaction input to module 200 typically includes 
descriptive information for a transaction such as quantity, 
25 features, and other characteristics that describe the 
transaction in greater detail and permit some value 
estimates to be specifically tailored for particular 
transactions . 

A first value estimate relies on a sum base and 
30 delta values block 211 which retrieves the base and delta 
values from database 202 that most approximate the desired 
transaction. Block 211 then sums the retrieved values to 
arrive at the first value estimate. 

A second value estimate relies on an expert system 
35 210 for computing values from the information retrieved from 

either or both of databases 202, 204. Expert system 210 
also may optionally receive a value estimate from either or 


- 34 - 



WO 98/43146 


PCT/US98/04878 


both of value estimators 215, 220 which are discussed in 
greater detail below, and may itself provide its value 
estimate to value estimators 215, 220. The implementation, 
development and training of an expert system for expert 
5 system 210 is in general known in the art, and any number of 
commercial expert system development packages may be used 
consistent with the invention. Moreover, the particular 
configuration of expert system 210 may vary greatly 
depending upon the market and goods /services for which agent 
10 100 is optimized to negotiate. 

Either of the first and second value estimates may 
be selected at a time as illustrated by OR gate 212, e.g., 
depending upon the price range and asset category of the 
goods or services which are the subject of the transaction. 
15 In the alternative, both value estimates may be utilized at 
the same time. 

A third value estimate may be obtained using a 
comparable transaction value estimator 215 which receives 
input from database 206, as well as from database 202 and 
20 expert system 210. In general estimator 215 compares past 
transactions with the desired transaction and generates for 
each past transaction (with the exception of any filtered 
out transactions) an estimated value based upon the 
proximity of the past transaction to the desired 
25 transaction. This is primarily accomplished through 

standardizing the past transactions in view of the 
characteristics of the desired transaction. The estimated 
values are then weighted and summed by blocks 232-240 as 
discussed below. 

30 Estimator 215 is illustrated in greater detail in 

Fig. 12. Descriptions and prices for past transactions are 
received from database 206 through an optional filter 207 
(discussed below) . The description for a past transaction 
is compared to the description of the desired transaction in 
35 difference block 216, resulting in one or more delta 
description signals representative of the proximity or 
relatedness of the past and desired transactions (e.g., 
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quantity, time, type, etc.). The delta description is 
supplied to database 202 and expert system 210, which in 
turn supplies a delta value representative of the 
descriptive changes between the past and desired 
5 transactions. The delta description may also be output as 
one or more proximity of transaction signals for weighting 
value estimates. 

For example, for the purchase of an automobile, if 
a past transaction is for an automobile which is identical 
10 except for leather seats, a delta value representative of 
the value of the leather seats may be output to correct the 
value of the past transaction to remove the value of the 
leather seats, thereby standardizing the past transaction to 
the characteristics of the desired transaction. Similar 
15 corrections may be made for other distinguishing 

characteristics between the past and desired transactions. 

A delta value is also output by database 202 and 
passed to an optional extrapolation block 217. Block 217 
calculates an alternate delta value to correct for time 
20 variations in applications where the value of goods or 

services varies (i.e., appreciates and/or depreciates) over 
time (e.g., with stocks, automobiles, real estate, etc.) 

For example, block 217 may maintain a record of 
the prices and times for all past transactions for 

25 particular goods or services. Individual records may first 

be standardized based upon the delta values provided by 
database 202. From the standardized past transactions, a 
curve fitting or other routine may be utilized to temporally 
extrapolate, or develop a trend for the value of the goods 
30 over time. The trend may then be used to correct the value 
of past transactions for current market conditions. As 
such, any depreciation or appreciation of the goods over 
time is accounted for in the delta value output from block 
217 . 

35 The delta value outputs of expert system 210 and 

extrapolation block 217 are selectively output from an OR 
gate 218 depending upon the particular application, market 
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and type of goods or services. In the alternative, the two 
outputs may be weighted and averaged to generate a single 
delta value. Regardless, the delta value output from gate 
218 is passed to summation block 219 and is added to the 
5 price for the past transaction to generate a standardized 
value estimate for the past transaction. 

As mentioned above, past transactions may be 
passed through an optional filter 207 to remove unreliable 
transactions from the value estimation and thereby hinder 
10 manipulation attempts by other parties. This may be 
performed in addition to, or in lieu of, weighting each past 
transaction as discussed below. 

For example, transactions involving known 
unreliable or corrupt agents, or involving the agent with 
15 which agent 100 is currently negotiating, may be filtered 
out. In addition, to prevent another party from entering 
into a number of small transactions to affect the market 
value of a transaction, low volume transactions below a 
certain threshold may be omitted. Moreover, open 
20 (unaccepted) offers may be filtered out, as may outlying 
transactions which fall well outside of the trend of past 
transactions. Particularly for supply and demand value 
estimator 220 discussed below, open offers which are outside 
of the trend of past transactions may be discarded. Other 
25 inherently less reliable transactions may also be filtered 
out consistent with the invention. 

Returning to Fig. 11, the value estimate for each 
past transaction in database 206 is weighted by a series of 
weighting blocks 232, 234, 236 and 238 based upon the 

30 proximity or similarity of the past transaction and the 
desired transaction. Any number of characteristics may be 
used to weight the transaction, including proximity in time 
(to emphasize recent transactions) , similarity in type (to 
emphasize transactions for similar features, etc.), quantity 
35 (to emphasize larger transactions) , and reliability (to de- 

emphasize transactions with extraneous circumstances) . 
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In the illustrated embodiment, weighting blocks 
232 and 234 receive the delta description value outputs from 
estimator 215 to weight the estimated value depending upon 
its similarity in type and its proximity in time to the 
5 desired transaction. Accordingly, more recent transactions 
are emphasized, as are transactions that are more similar in 
type to the desired transaction. 

Weighting block 236 receives the quantity of the 
past transaction to emphasize (weight more heavily) 
10 transactions for larger quantities. In addition, weighting 
block 238 receives a reliability signal related to the 
reliability of the past transaction. This signal may be 
obtained, for example, by identifying the agents involved in 
the past transaction (e.g., with routine 180 discussed above 
15 with reference to Fig. 10) . Transactions with unreliable 
agents, or with the same party as is involved in the current 
negotiation, may be de-emphasized to maintain the integrity 
of the value estimate. 

The weighted value estimates output from blocks 
20 232-238 are summed together and normalized in block 240. 

The output of this block is a single value estimate based 
upon all or at least a portion of the past transactions in 
database 206. 

A fourth value estimate may be obtained using a 
25 supply and demand value estimator 220 which receives input 
from database 208 and expert system 210. In general 
estimator 220 compares current buy and sell offers with the 
desired transaction and generates for each offer an 
estimated value based upon any differences between the offer 
30 and the desired transaction. This is primarily accomplished 
through standardizing the offers in view of the 
characteristics of the desired transaction. 

Estimator 220 is illustrated in greater detail in 
Fig. 13, where a comparable transaction value estimator 221 
35 receives current sell and buy offers from database 208. The 
sell and buy offers are separately weighted based upon their 
proximity to the desired transaction, then are summed and 
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normalized to generate a range from which the value estimate 
may be obtained. 

Estimator 221 is similarly configured to estimator 
215, except that current offers are compared to the desired 
5 transaction, rather than past transactions. It should be 
noted that estimator 221 may also be interconnected with 
database 202 and expert system 210 as with estimator 215; 
however, the signal paths therefor are omitted in Fig. 13 
for clarity. 

10 Sell offers are weighted by a plurality of 

weighting blocks 222, 223 and 224, then are summed and 
normalized in block 225. Similarly, buy offers are weighted 
by a plurality of weighting blocks 226, 227 and 228, then 
are summed and normalized in block 229. Control over 

15 weighting blocks 222 and 226 is provided by estimator 221, 
which supplies a weighting signal based upon the similarity 
in type between each offer and the desired transaction, 
thereby emphasizing more related offers. Control over 

weighting blocks 223 and 227 is also provided by estimator 
20 221, which supplies a weighting signal based upon the 

quantity of each offer, thereby emphasizing larger quantity 
offers. Control over weighting blocks 224 and 228 is 
provided by a reliability signal, e.g., that provided to 
block 238 in Fig. 11, to de-emphasize unreliable offers such 
25 as from unreliable agents or from the same agent with which 
negotiations are currently in progress. 

The outputs of blocks 225 and 229 typically 
represent minimum and maximum values for a range, since sell 
offers are typically lower on average than buy offers. The 
30 outputs are provided to a determine value from range block 
230 which outputs the value estimate based upon current 
market conditions. Block 230 may operate in a number of 
manners to select a value within the range of buy and sell 
offers. For example, block 230 may take the midpoint of the 
35 range, or may take the maximum or minimum of the offers 

depending upon whether agent 100 is a buying or selling 
agent. A more favorable price may be selected (e.g., the 
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maximum for a selling agent, and the minimum for a buying 
agent) . In the alternative, since profit and negotiating 
margins are added in the offer calculation, the less 
favorable price may be used (e.g., the minimum for a selling 
5 agent, and the maximum for a buying agent) . In addition, 

the outputs of blocks 225 and 229 may be weighted according 
to the number of buy and sell offers, or may be weighted 
inversely to grant equal weights to buy offers and sell 
offers. Other manners of selecting the value estimate may 
10 be used in the alternative. 

A number of modifications to estimator 220 may be 
made consistent with the invention. For example, the 
weighted averages of buy and sell offers may be replaced by 
a minimum of all sell offers and a maximum of all buy 
15 offers. In addition, a single weight and normalize step may 
be used on both the buy and sell offers. Moreover, buy and 
sell offers may be filtered as above for past transactions 
to limit the types of offers considered in the estimate 
calculation. 

20 Returning to Fig. 11, the value estimates output 

from estimators 215 and 220 and OR gate 212 are supplied to 
a weighting block 250 including a separate weighting block 
252, 254 and 256 for each value estimate. Each weighting 

block is controlled via a relative weight input to module 

25 200, where the weights to the three blocks 252, 254 and 256 

total 1. The weighted value estimates are then summed in 
block 258 to arrive at the final value estimate. 

The relative weights applied to the various value 
estimates may vary depending upon the particular goods or 
30 services and markets. Moreover, it is anticipated that such 
weights may be determined empirically for different 
applications, or may be selected by a user. In the 

alternative, one or more of the value estimates may be 

disregarded, e.g., if a value estimate differs from the 
35 other two value estimates by greater than a certain 

percentage, or if one or more value estimates is deemed 
unreliable due to either a small number of comparable 
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transactions or to all transactions having a relatively low 
similarity. 

The value estimates from past transactions and/or 
current buy and sell offers may be protected against 
5 manipulation in a number of manners. By weighting multiple 

past transactions and/or sell and buy offers, the relative 
effect of single transactions is minimized. Moreover, 
transactions for larger quantities are emphasized, thereby 
minimizing the effects of small transactions that may be 
10 made solely for the purpose of affecting the market. Also, 
through the filtering techniques discussed above, unreliable 
transactions from known corrupt agents or from the same 
agent which agent 100 is currently negotiating with may be 
filtered out, as may transactions and open offers which are 
15 well outside of the trend of the market. Furthermore, if 
the value estimate from past transactions differs greatly 
from the value estimate from current sell and buy offers 
(where what a significant difference is may vary based upon 
the particular market or upon history) , the value estimate 
20 from the current offers may be thrown out as being 
unreliable. 

It may also be possible to determine a reliability 
of the value estimate for past transactions and/or current 
sell and buy offers, e.g., through computing the average 
25 weight of the top n transactions used in the value estimate 
and the number of transactions used in the average. If the 
number or the weight is less than expected, the reliability 
of the estimate may be questionable and the behavior of the 
agent may be modified (e.g., by weighting the value estimate 
30 from database 202 or from expert system 210 more heavily) . 

In the alternative, the reliability may be determined by 
treating the weights of all the transactions or offers as 
distributions, then using statistical techniques such as 
average weight, number of points in distribution and 
35 standard deviation to determine the reliability. 

Various modifications may be made to the 
illustrated embodiments without departing from the spirit 
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and scope of the invention. For example, any of the above 
value estimators, weighting blocks and normalizing blocks in 
module 200 may be implemented using neural networks. Also, 
a number of variables and functions, such as the maximum and 
5 minimum wait times, required profit and negotiating margins, 
probability functions, and weighting of value estimates, 
among others, may be controlled by a user. 

In addition, a high pass filter may be used in a 
separate monitoring module in agent 100 to detect strong 
10 changes in the market and at least temporarily alter the 
negotiation strategy of the agent. Transactions are 
monitored as they occur, and a slope related to the 
differences in prices between one or more subsequent 
transactions is calculated in a known manner. Large 
15 positive or negative slopes therefore indicate fastly rising 
or falling prices. 

The trend of rising or falling prices is typically 
monitored over several transactions to ensure that 
intermittent deviations do not necessarily indicate a 
20 volatile market. The filter may be made less susceptible to 
manipulation by eliminating small transactions for 
quantities below a predetermined minimum, or by averaging 
the price over enough small transactions to make the 
predetermined minimum. 

25 As a result of a volatile market condition, the 

negotiation strategy of agent 100 may be overridden, e.g., 
to withdraw pending offers that are now worse for the client 
than is now available in the market, or to immediately 
accept pending offers without delay should they be better 
30 for the client than is now available in the market. The 
agent may also withdraw from trading until the volatility 
decreases. Probability functions may also be modified, for 
example, to make the agent more or less conservative 
depending upon market volatility. 

35 A high pass filter may also be used to override 

any {pstop losses]? or ]?stop gainst* issued to the agent. A 
Jpstop loss]? relates to an instruction to sell a product at 
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a certain price below the current market price if the market 
ever drops to that price. However, in a volatile market 
where market prices may drop rapidly, the market may drop 
below this price before the stop loss transaction can be 
5 completed. A similar situation may occur for bstop gain£> 
transactions issued when a client is selling short, when a 
market is rising faster than the stop gain transaction can 
be completed. 

By using the slope calculation from the high pass 
10 filter, a market low (or high) point, represented by a 
change in slope from negative to neutral or positive (or 
from positive to neutral or negative) over a number of 
transactions, may be detected and used to lock out stop loss 
(or stop gain) transactions. This would effectively prevent 
15 a sale from being made at the bottom (or top) of the market, 
when the market trend has reversed. The slope calculation 
may be performed on a per transaction or per elapsed time 
basis. 

For example, one suitable high pass filter 270 
20 having stop loss/gain protection is illustrated in Fig. 14. 

First, a new transaction is retrieved in block 272. Either 
of history of transaction database 206 and current market 
databases 208 may be utilized in this operation, or filter 
270 may separately monitor a market, or may receive updates 
25 from market monitoring agent 260 (Fig. 11) . 

The slope relative to a previous transaction is 
calculated in block 274. Next, block 275 determines whether 
the slope has exceeded a certain threshold for n 
transactions, indicating a volatile market condition. 
30 Typically, two or more slope calculations are used to 

minimize transient variations. The threshold will vary 
depending upon the particular goods/services and market. 

If a volatile market condition has been detected, 
control passes to block 276 to notify agent 100, whereby the 
35 agent negotiation strategy may be modified as discussed 

above. Control then passes to block 277. If no volatile 
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market condition is detected, control passes directly to 
block 277. 

Block 277 detects whether the slope has changed 
sign or turned neutral relative to a previous slope over m 
5 transactions, indicating that the market has bottomed out 
(when going from a negative to neutral or positive slope) or 
crested (when going from a positive to neutral or negative 
slope) . Slope computations over multiple transactions may 
be considered in this operation to minimize the effects of 
10 transient variations. If the slope has changed, the agent 
may be notified in block 279 to temporarily lock out any 
stop loss/stop gain transactions. Alternatively, stop loss 
transactions may be locked out only in response to a 
negative to positive or neutral slope change, and stop gain 
15 transactions may be locked out only in response to a 
contrary change. After the transactions are locked out, 
control returns to block 272 to process the next 
transaction. 

Returning to block 277, if the slope has not 
20 changed, control passes to block 278 to determine whether 
the transaction price has fallen significantly below the 
stop loss price, or has risen significantly above the stop 
gain price. If so, control passes to block 279 to 
temporarily lock out any stop loss/stop gain transactions, 
25 as discussed above. If not, control returns to block 272 to 
process the next transaction. It should be appreciated that 
block 278 may also be implemented by utilizing a range of 
prices for the stop loss and/or stop gain. 

Other modifications will be apparent to one 
30 skilled in the art. Therefore, the invention lies solely in 
the claims hereinafter appended. 
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Claims 

1 . A method of conducting an electronic transaction 
with an intelligent agent, the method comprising the steps 
of : 

(a) generating an offer to enter into a 
transaction; 

(b) waiting for a response from a negotiating 
party; 

(c) upon receiving a response, determining 
whether to complete the transaction; and 

(d) disguising a negotiation strategy from the 
negotiating party by randomizing a characteristic of at 
least one of the generating, waiting and determining 
steps . 

2. A method of conducting an electronic transaction 
with an intelligent agent, the method comprising the steps 
of : 

(a) generating an offer to enter into a 
transaction; 

(b) waiting for a response from a negotiating 
party; 

(c) upon receiving a response, determining 
whether to complete the transaction; and 

(d) limiting unproductive negotiations by 
constraining a characteristic of at least one of the 
generating, waiting and determining steps based upon at 
least one of a behavior of the negotiating party and a 
duration of the transaction. 


1 3. A method of identifying an unknown party 

2 interacting with an intelligent agent, the method comprising 

3 the steps of: 

4 (a) determining at least one attribute related to 

5 the unknown party; 
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6 (b) comparing the attribute for the unknown party 

7 with attributes related to a plurality of known 

8 parties; and 

9 (c) identifying the unknown party as the known 

10 party having the attribute which most closely matches 

11 that of the unknown party. 

1 4. A method of dynamically determining a value for a 

2 desired transaction, comprising the steps of: 

3 (a) generating a plurality of estimated values 

4 from a plurality of information sources; 

5 (b) weighting the plurality of estimated values 

6 based upon a predetermined criteria to generate a 

7 plurality of weighted estimated values; and 

8 (c) normalizing the plurality of weighted 

9 estimated values to generate the value for the desired 

10 transaction therefrom. 

1 
2 

3 

4 

5 

6 

7 

8 
9 

10 

11 


5. A method of dynamically determining a value for a 
desired transaction, comprising the steps of: 

(a) retrieving a plurality of related 
transactions, each related transaction having a value 
associated therewith; 

(b) for each related transaction, weighting the 
value of the related transaction based upon a proximity 
between the related and desired transactions to obtain 
a weighted value; and 

(c) normalizing the weighted values to generate 
the value for the desired transaction therefrom. 
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